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(54) COMMUNICATION APPARATUS AND METHOD 

(57) A direction detector section detects an eye 
direction or face direction of a conference attendant 
from image data picked up by a camera, and supplies 
information to an attention level detector section. Based 
on the information supplied from the direction detector 
section, the attention level detector section operates 
information (parameter) of a attention level to adjust 
sound data and/or image data of the other conference 
attendants inputted from the other remote conference 
apparatuses. An adjusting section adjusts correspond- 
ing sound data and/or image data by using information 
of the attention level supplied from the attention level 
detector section, and the data are outputted as sound 
from loudspeakers and displayed on monitor sections. 
In this manner, speech of each of the conference 
attendants can be heard easily and an image of each 
conference attendant can be watched easily. 
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Description 

Technical Field 

s [0001 ] Hie present invention relates to a communication apparatus and a method thereof and particularly to a com- 
munication apparatus and a method thereof in which sound volume, sound quality, image quality, and the like are 
adjusted in correspondence with an eye direction and a face direction of a user. 

Background Art 

JO 

[0002] In a conventional remote conference system, images and sounds are mutually communicated between a 
plurality of conference rooms through a network, and images and sounds in the conference rooms are reproduced in 
the other conference rooms, so that a conference can be held as if attendants sat around one table. 
[0003] Also, in a conventional remote conference system, attendants in conference rooms are able to speak simul- 

is taneously. Hence, when a plurality of attendants speak simultaneously, a conventional remote conference system 
causes a problem that a speech which is desired to hear is disturbed by other speeches and is difficult to hear. 
[0004] Also, in a conventional remote conference system, all images of respective conference rooms are arranged 
to have equal brightness and quality. Consequently, it is not possible, for example, to watch an image of a desired con- 
ference room brightened more or in more details. 

20 [0005] The present invention has been made on the basis of the situation described above and has an object of pro- 
viding a communication apparatus and a method thereof by which, for example, a desired speech can be heard easily 
and an image of a desired conference room can be watched also easily. 

Disclosure of the Invention 

25 

[0006] A communication apparatus according to the present invention is used in a communication system in which 
communication is made between three or more communication -apparatuses, and is characterized by comprising: a 
direction detector section for detecting a direction in which a user faces among a plurality of directions, where the direc- 
tions respectively correspond to other ones of the communication apparatuses; an attention level detector section for 
30 detecting attention levels at which the user faces in the plurality of directions, respectively, based on a detection result 
from the direction detector section; a receiver section for receiving information from the other ones of the communica- 
tion apparatuses; and an adjusting section for adjusting information from the other ones of the communication appara- 
tuses in correspondence with the attention levels. 

[0007] Here, when the direction detector section keeps detecting one same direction for a first time period or longer, 
35 the attention level detector section detects the attention level from the user as being high, with respect to the one same 
direction detected by the direction detector section. 

[0008] Also, based on detection of another one of the directions after the direction detector section keeps detecting 
the one same direction for the f irst time period or longer, the attention level detector section lowers the attention level. 
[0009] Also, if a second time period passes from a timing at which the direction detector section detects the another 
40 direction, the attention level detector section lowers the attention level. 

[001 0] Also, the attention level detector section gradually lowers the attention level in response to a timing at which 
the direction detector section detects the another direction. 

[0011] Also, the attention level detector section lowers the attention level gradually when a second time period 
passes from the timing when the direction detector section detects the another direction. 
45 [001 2] Also, the attention level detector section detects the attention level for each of the directions. 

[0013] Further, the adjusting section adjusts the information, based on the attention levels for the directions, 
respectively. 

[001 4] Also, the direction detector section detects an eye direction of the user. 
[001 5] Also, the direction detector section detects a face direction of the user. 
so [001 6] The adjusting section adjusts information corresponding to the direction in which the attention level is high, 
such that the information is emphasized relative to other information. 

[0017] The communication apparatus according to the present invention further comprises a presentation section 
for presenting the information adjusted by the adjusting section to a user. 

[001 8] Here, the information is sound information and the adjusting section adjusts sound information presented by 
55 the presentation section. 

[001 9] The adjusting section adjusts sound volume of the sound information presented by the presentation section. 
[0020] Also, the adjusting section adjusts sound quality of the sound information presented by the presentation sec- 
tion. 
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[0021 ] Also, the information is image information and the adjusting section adjusts the image information presented 
by the presentation section. 

[0022] The adjusting section adjusts image quality presented by the presentation section. 
[0023] The presentation section includes a plurality of presentation sections respectively corresponding to the plu- 
rality of directions. 

[0024] The communication apparatus according to the present invention further comprises an obtaining section for 
obtain formation of the user, and a transmitter section for transmitting the information of the user obtained by the obtain- 
ing section to the other communication apparatuses. 

[0025] Next, a communication method according to the present invention is used for a communication system in 
which communication is made between three or more communication apparatuses, and is characterized by comprising: 
a direction detecting step of detecting a direction in which a user faces among a plurality of directions in a state where 
the plurality of directions respectively correspond to other ones of the communication apparatuses; an attention level 
detecting step of detecting attention levels at which the user faces in the plurality of directions, respectively, based on a 
detection result in the direction detecting step; and an adjusting step of adjusting information received from the other 
ones of the communication apparatuses in correspondence with the attention levels. 

[0026] Here, in the attention level detecting step, when one same direction is kept detected for a first time period or 
longer, the attention level from the user is detected as being high, with respect to the detected one same direction. 
[0027] Also, in the attention level detecting step, based on detection of another one of the directions after the one 
same direction is kept detected for the first time period or longer, the attention level is lowered. 
[0028] Also, in the attention level detecting step, if a second time period passes from a timing at which the another 
direction is detected, the attention level is lowered. 

[0029] Also, in the direction detecting step, the attention level is gradually lowered in response to a timing at which 
the another direction is detected. 

[0030] Also, in the attention level detecting step, the attention level is gradually lowered if a second time period 

passes from the timing when the another direction is detected in the direction detecting step. 

[0031] Also, in the attention level detecting step, the attention level is detected for each of the directions. 

[0032] Further, in the adjusting step, the information is adjusted, based on the attention levels for the directions. 

respectively. 

[0033] Also, in the direction detecting step, an eye of the user is detected. 
[0034] Also, in the direction detecting step, a face direction of the user is detected. 

[0035] In the adjusting step, information corresponding to the direction in which the attention level is high, is 
adjusted to be emphasized relative to other information. 

[0036] The communication method according to the present invention further comprises a presentation step of pre- 
senting the information adjusted in the adjusting step to a user. 

[0037] Also, in the adjusting step, sound information presented in the presentation step is adjusted. 

[0038] Also, in the adjusting step, sound volume of sound information presented in the presentation step is 

adjusted. 

[0039] Also, in the adjusting step, sound quality of sound information presented in the presentation step is adjusted. 
[0040] Here, the information is image information, and in the adjusting step, image information presented in the 
presentation step is adjusted. 

[0041 ] In the adjusting step, image quality of the image information presented in the presentation step is adjusted ' 
[0042] Also, the presentation step includes a step of performing a plurality of presentations respectively corre- 
sponding to the plurality of directions.. 

[0043] The communication method according to the present invention further comprises an obtaining step of 
obtaining formation of the user, and a transmitting step of transmitting the information of the user obtained in the obtain- 
ing step to the other communication apparatuses. . 

Brief Description of the Drawings 



50 [0044] 

FIG. 1 is a block diagram showing a structural example of a remote conference system to which the present inven- 
tion'ts applied. 

55 FIG. 2 is a block diagram showing a structural example of one of remote conference apparatuses constructing a 
remote conference system. 



FIG. 3 is a block diagram showing a structural example of a main part of a remote conference apparatus. 
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FIG. 4 is a block diagram showing a specific structural example of a main part of a remote conference apparatus. 

FIGS. 5 A to 50 are timing charts used for explaining the processing operation of a direction detector section, an 
. attention level detector section, and an adjusting section in a remote conference apparatus. 

5 

FIG. 6 is a flowchart showing a flow of attention level detection processing. 
FIG. 7 is a flowchart showing a flow of operation processing of an attention level. 
10 FIG. 8 is a flowchart showing a flow of eye detection processing. 

FIG. 9 is a view used for explaining a position detection range of both ends of an eye. 
FIG. 10 is a view used for explaining a position detection range of a nostril. 

15 

FIG. 1 1 is a view used for explaining both end positions of eyes, positions of nostril, and center positions of eye- 
balls. 

FIG. 12 is a view used for explaining detection of a direction of an eye. 

20 

FIG. 13 is a view used for explaining how to obtain a line which minimizes a secondary moment of a set of particular 
pixels. 

FIG. 14 is a flowchart showing a flow of face direction detection processing. 

25 

FIGS. 1 5A and 15B are views showing original images in face direction detection. 

FIGS. 16A and 16B are views used for explaining a hair area and a skin area in face direction detection. 

so FIGS. 1 7A and 1 7B are views used for explaining barycenters of a hair area and a sWn area. 

FIG. 18 is a graph showing an example of a relation between a difference value and an angle in face direction 
detection. 

35 FIG. 19 is a block diagram showing a structural example of a main part in case of controlling sound volume in a 
remote conference apparatus. 

FIG. 20 is a block diagram showing a specific structural example of a main part in case of controlling sound volume 
in a remote conference apparatus. 

40 

FIG. 21 is a flowchart showing a flow of sound volume control processing. 

FIG. 22 is a block diagram showing a structural example of a main part in case of controlling sound quality in a 
remote conference apparatus. 

45 

FIG. 23 is a block diagram showing a specific structural example of a main part in case of controlling sound quality 
in a remote conference apparatus. 

FIG. 24 is a block diagram showing a specific structural example of a sound processor in case of controlling sound 
so quality. 

FIG. 25 is a graph showing a frequency characteristic of an input sound signal to a sound processor. 
FIG. 26 is a graph showing a frequency control characteristic of a sound processor. 

55 

FIG. 27 is a graph showing a frequency characteristic of an output sound signal from a sound processor. 
FIG. 28 is a flowchart showing a flow of sound quality control processing. 
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FIG. 29 is a block diagram showing a structural example of a main part in case of performing image control in a 
remote conference apparatus. 

FIG. 30 is a block diagram showing a specific structural example of a main part in case of performing image control 
5 in a remote conference apparatus. 

FIG. 31 is a block diagram showing a specific structural example of an image processor in case of performing 
image control. 

io FIG. 32 is a flowchart showing a flow of image control processing. 

FIG. 33 is a block diagram showing a schematic structure in case where images of conference attendants are dis- 
played on a screen and sound images are positioned by loudspeakers, as another example of a remote conference 
apparatus of the present invention. 

15 

FIG. 34 is a block diagram showing a schematic structure in case where images of conference attendants are dis- 
played on a screen and two conference attendants can sit together, as another example of a remote conference 
apparatus of the present invention. 

20 FIG. 35 is a block diagram showing a schematic structure in case where images of conference attendants are dis- 
played on a screen and sound images are positioned by headphones, as another example of a remote conference 
apparatus of the present invention. 

FIG. 36 is a block diagram showing a schematic structure in case where only sounds of conference attendants are 
25 communicated, as another example of a remote conference apparatus of the present invention. 

Best Mode For Carrying Out the Invention 

[0045] A preferable embodiment of the present invention will be explained below with reference to the drawings. 
30 [0046] FIG. 1 shows a schematic structure of a remote conference system as an example to which a communica- 
tion apparatus and a method thereof according to the present invention are applied. In the present specification, a sys- 
tem means a total structure based on a plurality of apparatuses and sections. 

[0047] In the remote conference system shown in FIG. 1. a plurality of remote conference apparatuses 1A to 1D 
(which wilt be simply described as remote conference apparatuses 1 hereinafter where it is not necessary to distinguish 
35 the remote conference apparatuses 1 A to 1 D from each other) are connected through ISDN (Integrated Services Digital 
Network) 2, for example. In a remote conference apparatus 1, image data and sound data of conference attendants 3 
which are taken in by the remote conference apparatus 1 can be mutually communicated to other remote conference 
apparatuses 1 through ISDN 2, and image data and sound data transmitted from other remote conference apparatuses 
1 can be reproduced. 

40 10048] Although four remote conference apparatuses 1 A to 1 D are shown to simplify illustration of FIG. 1 , it is also 
possible to connect further more remote conference apparatuses. ISDN 2 is given merely as an example of a commu- 
nication network, and another transmission medium such as a cable television network, Internet, digital satellite com- 
munication, or the like can be used in place of the ISDN 2. 

[0049] Each of the remote conference apparatuses 1 A to 1D that construct the remote conference system has a 
45 structure as shown in FIG. 2. FIG. 2 shows a detailed structural example of the remote conference apparatus 1 A among 
the remote conference apparatuses 1A to 1D, for example. The structures of the remote conference apparatuses 1B, 
1 C and 1 D are the same as that of the remote conference apparatus 1 A. and explanation thereof will therefore be omit- 
ted herefrom. 

[0050] The remote conference apparatus 1 A is constructed by at least a reproduction device 101 which reproduces 
so image data and sound data of a conference attendant 3B transmitted from the remote conference apparatus 1B, a 
reproduction device 102 which reproduces image data and sound data of a conference attendant 3C transmitted from 
the remote conference apparatus 1C, and a reproduction device 103 which reproduces image data and sound data of 
a conference attendant 3D transmitted from the remote conference apparatus 1D. These reproduction devices 101, 
102, and 103 are provided as if the conference attendant 3A and the other conference attendants 3B, 3C, and 3D sat 
55 around one table and had a conference. 

[0051] A monitor section 111 of the reproduction device 101 displays image data (image data of the conference 
attendant 3B and the periphery of the attendant) transmitted from the remote conference apparatus 1 B, and a loud- 
speaker 121 reproduces sound data (speech of the conference attendant 3B) transmitted from the remote conference 
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apparatus 1 B. A monitor section 1 1 2 of the reproduction device 102 displays image data (image data of the conference 
attendant 3C and the periphery of this attendant) transmitted from the remote conference apparatus 1C, and a loud- 
speaker 122 reproduces sound data (speech of the conference attendant 3C) transmitted from the remote conference 
apparatus 1C. Likewise, a monitor section 1 13 of the reproduction device 103 displays image data (image data of the 
s conference attendant 3D and the periphery of this attendant) transmitted from the remote conference apparatus 1C. 
and a loudspeaker 123 reproduces sound data (speech of the conference attendant 3D) transmitted from the remote 
conference apparatus 1 D. 

[0052] A camera 1 3 which picks up the image of the conference attendant 3A and a microphone 1 4 which collects 
the sound of speech of the conference attendant 3 A are provided above the reproduction device (reproduction device 
10 102 in the example of FIG. 2) placed in front of the conference attendant 3 A. The image data which the camera 1 3 picks 
up and the sound data which the microphone 14 collects are transmitted to the remote conference apparatuses 1 B, 1 C. 
and 1D through ISDN 2. 

[0053] The remote conference apparatus 1 A comprises components shown in FIG. 3 as a structure of its main part. 
A specific structure and layout of components of the remote conference apparatus 1 A including the components of the 

is main part shown in FIG. 3 are arranged as shown in FIG. 4. 

[0054] In FIGS. 3 and 4, if a plurality of directions viewed from the conference attendant 3 A respectively correspond 
to the remote conference apparatus 1 B, 1 C, and 1 D, the remote conference apparatus 1 A comprises a direction detec- 
tor section 1 5 for detecting a direction in which the conference attendant 3 A faces, attention level detector sections 131. 
132, and 133 for detecting respectively attention levels of the conference attendant 3A with respect to the directions, 

20 based on a result detected by the direction detector section 15. an ISDN connection terminal 1 7 and a data transmit- 
ter/receiver 16 which receive image data and sound data from the other remote conference apparatuses 1B, 1C, and 
1D, and adjusting sections 161 , J 62, and 163 which adjust image data and/or sound data transmitted from the other 
remote conference apparatuses 1 B, 1C, and 1 D in correspondence with the attention levels. The attention level detector 
sections 131, 132, and 133, as well as the adjusting sections 161. 162, and 163 arranged in rear stages thereof, are 

25 respectively provided in correspondence with the reproduction devices 101 , 102, and 1 03. Details and a specific exam- 
ple of the directions and the attention levels mentioned above will be described later. 

[0055] The direction detector section 15 analyzes image data of the conference attendant 3A supplied from the 
camera 13, detects the direction in which the conference attendant 3A faces at a certain sampling rate, and supplies a 
defection result to the attention level detector sections 131, 132, and 133. 

30 [0056] That is, as shown in FIG. 5A, the direction detector section 15 detects a period lb for which the conference 
attendant 3 A faces to the monitor section 1 1 1 on which the conference attendant 3B is displayed, a period Ic for which 
the conference attendant 3 A faces to the monitor section 1 12 on which the conference attendant 3C is displayed, a 
period Id for which the conference attendant 3 A faces to the monitor section 1 13 on which the conference attendant 3D 
is displayed, and a period Inon for which the conference attendant 3 A faces to none of the monitor sections 1 1 1 to 1 1 3, 

35 as information representing the direction in which the conference attendant 3 A faces and the duration time for which the 
attendant keeps the direction. 

[0057] Next, the direction detector section 1 5 generates a signal obtained by extracting only the period lb for which 
the conference attendant 3 A faces the monitor section 1 1 1 among the detected periods lb. Ic, Id, and Inon as is shown 
in FIG. 5B, and supplies the signal to the attention level detector section 131. Likewise, the direction detector section 

40 1 5 generates a signal obtained by extracting only the period Ic for which the conference attendant 3A faces to the mon- 
itor section 1 1 2 among detected periods lb. Ic, Id, and Inon and supplies the signal to the attention level detector section 
132, as well as the direction detector section 1 5 generates a signal obtained by extracting only the period Id for which 
the conference attendant 3A faces to the monitor section 1 13 among the detected periods lb. Ic. Id, and Inon, and sup- 
plies the signal to the attention level detector section 133. 

45 [0058] The attention level detector section 131 determines whether or not there is a period lb which particularty 
continues for a time Tcont or longer among periods lb, based on the signal supplied from the direction detector section 
15. If a period lb continues for the Tcont or longer, as shown in FIG. 5C, the attention level detector section 131 detects 
the time which exceeds the time Tcont, as a time for which the conference attendant 3 A faces particularly to the monitor 
section 111 on which the conference attendant 3B is displayed. Further, if the attention level detector section 131 

so detects the time for which the conference attendant 3A faces to the monitor section 1 1 1 , as shown in FIG. 5D, the atten- 
tion level detector section 131 obtains a parameter P (t) as an attention level used for adjustment which is made by the 
adjusting section 161 on the image data and/or the sound data of the conference attendant 3B transmitted from the 
remote conference apparatus 1 B, based on the timing at which the time is detected. 

[0059] Specifically, the attention level detector section 131 obtains the parameter P (t) at the time point t by an oper- 
55 ation using the expression (1) below. 



P(t) = (1 -Pmin)A* aW +Pmin 
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[0060] The minimum parameter Pmin and the constant A in the expression (1), and the time Tatt and the time Tcont 
shown in FIG. 5 are constants that satisfy the expressions (2) to (5) below. 

0 £ Pmin s 1 (2) 

5 

A > 1 (3) 

Tatt £ 0 (4) 

io Tcont * 0 (5) 

[0061] tf a variable p (t)=t - (where t is the time point when the conference attendant 3A last faced to the monitor 
section 1 1 1) is defined, the value of the variable a (t) is 0 where p (t) < Tatt is given, and the value of the variable a (t) 
is p (t) - Tatt where p (t) £ Tatt is given. The definition that the conference attendant 3A faces to the monitor section 1 1 1 
is at the time point t means that the conference attendant 3A faces in a direction toward the monitor section 1 1 1 from the 
time point (t - Tcont) to the time point t. 

[0062] That is. if the time Tcont passes in a state where the conference attendant 3A keeps facing to the monitor 
section 111, the attention level detector section 131 determines that the conference attendant 3A pays particular atten- 
tion to the monitor section 111, and the parameter P (t) is set to the maximum value 1), as indicated in FIG. 5 and by 
20 the expression (1). Thereafter, if the direction in which the conference attendant 3A faces turns away from the monitor 
section 1 1 1 , the attention level detector section 131 maintains the parameter P (t) at the maximum value from the time 
point when the direction turns away to the time point when Tatt passes. After the time Tatt passes, the attention level 
detector section 131 changes the parameter P (t) so as to decrease from the maximum value to the minimum parameter 
Pmin gradually. 

25 [0063] Like in the case of the attention level detector section 131. the attention level detector section 132 deter- 
mines whether or not there is a period Ic which continues for the time Tcont or longer among periods Ic. based on the 
signal supplied from the direction detector section 1 5. If there is a period Ic which continues for the Tcont or longer, the 
time which exceeds the time Tcont is detected as the time for which the conference attendant 3A particularly pays atten- 
tion to the monitor section 1 12 on which the conference attendant 3C is displayed. Further, if the attention level detector 

30 section 1 32 detects the time for which the conference attendant 3 A faces to the monitor section 1 1 2, the attention level 
detector section 1 32 obtains a parameter P (t) as an attention level for adjustment which is made by the adjusting sec- 
tion 162 on the image data and/or the sound data of the conference attendant 3G transmitted from the remote confer- 
ence apparatus 1 C, based on the timing at which the time is detected. 

[0064] That is, if the time Tcont passes in a state where the conference attendant 3A keeps facing to the monitor 
35 section 1 12, the attention level detector section 132 determines that the conference attendant 3 A faces particularly to 
the monitor section 1 12. and the parameter P (t) is set to the maximum value (= 1). Thereafter, if the direction in which 
the conference attendant 3A faces turns away from the monitor section 112.- the attention level detector section 132 
maintains the parameter P (t) at the maximum value from the time point when the direction turns away to the time point 
when Tatt passes. After the time Tatt passes, the attention level detector section 132 changes the parameter P (t) so as 
40 to decrease from the maximum value to a minimum parameter Pmin gradually. 

[0065] Likewise, the attention level detector section 133 determines whether or not there is a period Id which con- 
tinues for the time Tcont or longer among periods Id. based on the signal supplied from the direction detector section 
15. If there is a period Id which continues for Tcont or longer, the time which exceeds the time Tcont is detected as the 
time for which the conference attendant 3A faces particularly to the monitor section 113 on which the conference 
4$ attendant 3D is displayed. Further, if the attention level detector section 133 detects the time for which the conference 
attendant 3A faces to the monitor section 1 13, the attention level detector section 133 obtains a parameter P (t) as an 
attention level for adjustment which is made by the adjusting section 163 on the image data and/or the sound data of 
the conference attendant 3D transmitted from the remote conference apparatus 1 D, on the basis of the timing at which 
the time is detected. 

so [0066] That is, if the time Tcont passes in a state where the conference attendant 3A keeps facing to the monitor 
section 113, the attention level detector section 133 determines that the conference attendant 3A faces particularly to 
the monitor section 1 13. and the parameter P (t) is set to the maximum value 1). Thereafter, if the direction in which 
the conference attendant 3A faces turns away from the monitor section 113, the attention level detector section 133 
maintains the parameter P (t) at the maximum value from the time point when the direction turns away to the time point 

55 when Tatt passes. After the Time Tatt passes, the attention level detector section 133 changes the parameter P (t) so 
as to decrease from the maximum value to the minimum parameter Pmin gradually. 

[0067] FIG. 6 shows a flow of processing when the attention level detector sections 131 , 132, and 133 respectively 
detect whether or not the conference attendant 3A faces to the monitor sections 1 1 1 , 1 1 2, and 1 1 3, based on the signal 
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supplied from the direction detector section 15. The contents of processing in the attention level detector sections 131 . 
132, and 133 are equal to each other and will therefore be explained with only the attention level detector section 131 
taken as an example. 

[0063] In FIG. 6. in the attention level detector section 131 . the present time t is firstly stored into a variable curj, 
5 as a step S21 , and further, the variable cur Jt expressing the present time t is stored into the value of a variable begj 
expressing the time at which the conference attendant 3 A comes to face to the monitor section 11 1 , as a step S22. Ini- 
tialization is thus carried out After the initialization is carried out the processing in the attention level detector section 
131 goes to a step S23. 

[0089] The processing thus goes to the step S23, and the attention level detector section 131 then carries out an 
10 operation of (cur_t) (begj) which expresses how long time has passed since the conference attendant 3A faced to the 
monitor section 111, and determines whether or not the time obtained by the expression is equal to or longer than the 
time Tcont. Immediately after the initialization, since values of the variable beg_t and the variable cut_t are equal to 
each other, (curj) - (begj) = 0 is given, so the attention level detector section 131 determines "No" in the step S23 at 
this time. 

is [0070] If the attention level detector section 131 determines "No" in the step S23, the attention level detector sec- 
tion 131 sets a value of "0" as shown in FIG. 5C, regarding the conference attendant 3A as not facing to the monitor 
section 1 1 1 , as processing in a step S25, and the processing goes to a step S26. 

[0071 ] The processing thus goes to the step S26, and the present time t is then stored in the variable cut_t in the 
attention level detector section 131 . The processing goes then to a step S27. 

20 [0072] . The processing thus goes to the step S27, the attention level detector section 131 then determines whether 
or not a sjgnal expressing a period lb supplied from thedirectjon detector section 15 is "1" i.e.^_whether or notthe con- 
ference attendant 3A faces to the monitor section 1 1 1 . rf the attention level detector section 131 determines "No" in the 
step S27, the attention level detector section 131 stores the variable cur_t into the variable begj as processing in a step 
S28 and thereafter returns to the processing in the step S23. 

25 [0073] After returning to the process of the step S23, the attention level detector section 131 determines whether 
or not the time given by the expression (cur_t) - (begj) is equal to or longer than the time Tcont. In the processing of 
the step S23, if the time given by the expression (curj) - (begj) is equal to or longer than the time Tcont the process- 
ing in the attention level detector section 131 goes to a step S24. 

[0074] After the proceeding goes to the step S24, the attention level detector section 1 31 sets a value "1 " as shown 
30 in FIG. 5C. regarding the conference attendant 3A as facing to the monitor section 111, and goes to the steps from the 
step 26. The processing from the step S26 is the same as described above. 

[0075] FIG. 7 shows a flow of processing of operating the parameter P (t) in the attention level detector sections 
131 . 132 and 133. The contents of the processing in the attention level detector sections 131. 132, and 133 are equal 
to each other, and therefore, explanation will be made only to the attention level detector section 131 as an example. 

35 [0076] In FIG. 7, the attention level detector section 131 carries out initialization as follows. The present time t is 
firstly stored into a variable cr_t, as a step S3 1, and further, a value of(curJ-Tinit) is stored into a value of a variable 
bg_t expressing the time at which the conference attendant 3 A comes to face to the monitor section 111 , as a step S32. 
Tinit is an initial value of the variable p which is used when the parameter P is finally operated. After the initialization 
was completed, the processing in the attention level detector section 131 goes to a step S33. 

40 [0077] After the process goes to the step S33, the attention level detector section 131 makes operation of (curj) - 
(begj) which expresses how long time has passed since the conference attendant 3A turned to face to the monitor sec- 
tion 1 1 1 , and stores the value obtained by the operation into the variable p. 

[0078] Next, the attention level detector section 131 determines whether or not the variable p is equal to or longer 
than the time Tcont, i.e., whether or not the elapsed time since the conference attendant 3 A stopped facing to the mon- 

45 itor section 1 1 1 is equal to or longer than the time Tatt. If the attention level detector section 131 determines "No" in the 
step S34, the attention level detector section 131 stores a value of into the expression (1) as processing in a step S36. 
Meanwhile, if the attention level detector section 131 determines "Yes* in the step S34, the attention level detector sec- 
tion 131 stores a value of(p-Tatt) into the variable a of the expression (1) as processing of a step S35. After the process- 
ing in the steps S35 and S36, the processing in the attention level detector section 131 proceeds to a step S37. 

so [0079] -.. After the process goes to the step S37, the attention level detector section 1 31 obtains the parameter P by 
the expression (1), and thereafter stores the present time t into the variable cut J as processing in a step S38. 
[0080] Next, the attention level detector section 131 goes to processing in a step S39. and determines whether or 
not the conference attendant 3A faces to the monitor section 111, i.e., whether or not the signal is "1" as shown in FIG. 
SC. If the attention level detector section 131 determines "No" in the step S39, the attention level detector section 131 

55 returns to the processing in the step S33. If the attention level detector section 131 determines "Yes" the attention level 
detector section 131 returns to the processing in the step S33, after storing the variable crj into the variable bgj, as 
processing in a step S40. Processing after the step S33 is the same as described above. 

[0081] Returning to FIG. 3 and 4, the parameter P (t) outputted from the attention level detector section 131 is 
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transmitted to the adjusting section 161, the parameter P (t) outputted from the attention level detector section 132 is 
transmitted to the adjusting section 162. and the parameter P (t) outputted from the attention level detector section 133 
is transmitted to the adjusting section 163. Image data and sound data transmitted from the remote conference appa- 
ratus 1 B are supplied to the adjusting section 161 through the data transmitter/receiver 16. image data and sound data 
5 transmitted from the remote conference apparatus 1 C are supplied to the adjusting section 1 62 through the data trans- 
mitter/receiver 16, and image data and sound data transmitted from the remote conference apparatus 1 D are supplied 
to the adjusting section 163 through the data transmitter/receiver 16. 

[0082] When the adjusting section 1 61 receives a parameter P (t) supplied from the attention level detector section 
131 , the adjusting section 161 adjusts sound data and/or image data of the conference attendant 3B supplied from the 

10 remote conference apparatus 1 B on the basis of the parameter P (t). Also, when the adjusting section 1 62 receives a 
parameter P (t) supplied from the attention level detector section 132, the adjusting section 162 adjusts sound data 
and/or image data of the conference attendant 3C supplied from the remote conference apparatus 1C on trie basis of 
the parameter P (t). Likewise, when the adjusting section 163 receives a parameter P (t) supplied from the attention 
level detector section 133, the adjusting section 1 63 adjusts sound data and/or image data of the conference attendant 

is 3D supplied from the remote conference apparatus 1 D on the basis of the parameter P (t). The detail of a specific con- 
tent of the adjustment in the adjusting sections 161 . 162 and 163 will be described below. 

[0083] The sound signal outputted from the adjusting section 161 is supplied to the loudspeaker 121 and sound is 
generated. The image signal outputted therefrom is supplied to the monitor section 1 1 1 and displayed. Also, the sound 
signal outputted from the adjusting section 162 is supplied to the loudspeaker 122 and sound is generated. The image 
20 signal outputted therefrom is supplied to the monitor section 112 and displayed. Likewise, the sound signal outputted 
from the adjusting section 163 is transmitted to the loudspeaker 123 and sound is generated. The image signal output- 
ted therefrom is transmitted to the monitor section 1 13 and displayed. 

[0084] Explained next will be a specific example of direction detection performed by the direction detector section 
15 in the remote conference apparatus 1 A according to the present embodiment. 
25 [0085] Detection of an eye direction of the conference attendant 3A can be cited as a specific example of the direc- 
tion detection. 

[0086] FIG. 8 shows a flow of processing of detecting an eye direction in the direction detector section 1 5. 
[0087] In FIG. 8, if image data picked up by the camera 13 is supplied to the direction detector section 15 in a step 
S1 1 , the direction detector section 1 5 detects contours of both eyes by using the color information of the supplied 
30 image, as processing in the next step S12. That is, the direction detector section 15 extracts color areas, such as skin, 
white parts of the eyes, irises, and the like, and obtains, for example, a boundary between the color areas extracted, 
thereby to detect a contour E of the right eye and a contour E of the left eye, as shown in FIG. 9. FIG. 9 shows only one 
eye. 

[0088] Next, as processing in a step S13, the direction detector section 15 obtains positions of both right and left 
35 end points G1 and G2 of the right eye, as well as positions of both right and left end points G1 and G2 of the left eye, 
based on each contour E obtained in the step S12. With the positions of right and left ends points G1 and G2 of each 
of the right and left eyes used as references, the direction detector section 15 determines a search range NE to search 
nostrils shown in FIG. 10 and detects positions of the nostrils NH from the search range NE. That is. with respect to 
each of the left and right eyes, the direction detector section 15 obtains a barycenter Q of a set of pixels forming the 
40 contour E of the eye and a line M which minimizes a secondary moment (the moment concerning the line) of the set of 
pixels forming the contour E of the eye. Further, from the set of pixels forming the contour E of each eye, the direction 
detector section 15 obtains pixels at positions which are apart from the barycenter Q by maximum distances L1 and L2 
in the left and right directions on the line M, respectively, and these pixel positions are obtained as the left and right end 
points G1 and G2. Subsequently, as shown in FIG. 10, the direction detector section 15 determines the search range 
45 NE to search the nostrils in the lower sides than the left and right end points G1 and G2, with the positions of left and 
right ends points G1 and G2 of the right and left eyes used as references, which are determined previously. At this time, 
since the image of the portions of the nostrils NH are picked up to be darker in comparison with the other sections, the 
direction detector section 15 detects image portion where luminance is low within the search range NE, as positions of 
the nostrils NH. 

so [0089] Next, as shown in FIG, 1 1 , the direction detector section 1 5 estimates a center position EC of a eyeball EB 
and a radius r of the eyeball EB on the basis of a geometric positional relationship among the positions of the left and 
right ends points G1 and G2 of the right eye, the positions of the left and right ends points G1 and G2 of the left eye. 
and the positions of the nostrils NH, as processing in the step S 14. 

[0090] Further, as shown in FIG. 1 0. the direction detector section 1 5 detects center positions EAC of pupils EA by 
55 using luminance information of images inside the contours E of right and left eyes as processing in the step 515. 

[0091] Next, as processing in the step S1 6 shown in FIG. 12. the direction detector section 15 operates a vector EV 
that connects the center position EC of the eyeball EB detected in the step S1 4 with the center position EAC of the pupil 
EA detected in the step S15. and makes a direction determination, i.e., determines which of the monitor sections 1 1 1 
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to 1 13 the vector EV is oriented to, with the vector EV taken as an eye direction. 

[0092] From the flow described above, the direction detector section 1 5 detects the eye direction of the conference 
attendant 3 A. 

[0093] The line M which minimizes the secondary moment of a particular set of pixels such as a contour E can be 
s obtained by the following operation, for example. • 

[0094] Here, the line M expressed by an expression (6) is taken as an example, as shown in FIG. 13. 

xsine -ycose + p = 0 (6) 

10 [0095] If a distance between each point fa, y f ) on the set of pixels of the contour E and the line M is Rj, a secondary 
moment m relating to the line M can be expressed by an expression (7). 

m= 1 1 R , 2 = ,Z(x ,sin0-y jCOse+p) 2 (7) 

is [0096] That is. the line M that minimizes the secondary moment is the line M that minimizes m of the expression 
(7). In conclusion, in order to minimize m of the expression (7), values which satisfy the following expressions (8) and 
(9) are used as 8 and p of the expression (7). 

0 : sin26 = b/(b 2 + (a-c) 2 ) 1/2 ,cos20 = (a-c)/(b 2 + (a-c) 2 ) 1/2 (8) 

20 

p : p = -x 0 sin9 + y 0 cose (9) 

[0097] (x 0 sine -y O cose + p * 0 ) in the expression (9) means that this passes the barycenter of the set of pixels. 
[0098] However, in the above expressions (8) and (9), a, b and c are expressed by the following expressions (10). 
25 (11) and (1 2). (xq y 0 ) expresses the barycenter of the set of pixels. 

a=,X(x r x 0 ) 2 (10) 

b^iXtXj-XoKyi-yo) (11) 

30 

c=|£(y,-y 0 ) 2 (12) 

[0099] Another example of direction detection carried out in the direction detector section 15 of the remote confer- 
ence apparatus 1 A according to the present embodiment will be detection of the direction of the face of the conference 
35 attendant 3A. 

[01 00] FIG. 14 shows a flow of processing in case of carrying out the face direction detection by the direction detec- 
tor section 15. 

[0101 ] In FIG. 14, for example, if original image data picked up by the camera 13 as shown in FIGS. 15A and 156 
is supplied as processing in a step S51 , the direction detector section 15 detects a skin area and a hair area by using 
40 color information of the supplied image, as processing of a next step S52. That is. the direction detector section 15 
extracts, for example, color areas of skin and hair from color information of the supplied image, and detects a skin area 
se and a hair area he by the extracted color areas, as shown in FIG. 1 6A and 16B. 

[0102] Next, as processing in a step S53. the direction detector section 1 5 carries out setting of a frame to detect 
a barycenter fq of a sum area fe of the skin area se and the hair area he (=se + he) . and a barycenter sq of the skin 

45 area se as. shown in FIGS. 17A and 17B. Here, setting of the frame is carried out by, for example, specifying a range 
in a vertical direction of the image. More specifically, the specification of the range is carried out, for example, by using 
the upper end re of the sum area fe of the hair area he and the skin area se used as a reference, such that the range 
is set from a section const_a in the downward direction from the upper end re to a section const_a +const_b. 
[01 03] Subsequently, as processing in the step S54, the direction detector section 1 5 obtains a barycenter fq of the 

so sum area fe of the hair area he and skin area se and a barycenter sq of the skin area se within the range of the frame 
set in the step S53. These barycenters are utilized in case where face direction detection is carried out in both the hor- 
izontal and vertical directions or in either the horizontal or vertical direction, in later processing. However, explanation 
will now be made of a case in which barycenters are used for face direction detection in the horizontal direction, as an 
example. 

55 [0104] The direction detector section 15 obtains the barycenter fq of the sum area fe of the hair area he and the 
skin area se, and the barycenter of the skin area se, in the step S54. Then, as processing in a step S55, the direction 
detector section 15 obtains a difference value by subtracting a value of the barycenter of the sum area fe of the hair 
area he and the skin area se from a value of the barycenter of the skin area se. 
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[01 05] Next, as processing in a step S56, the direction detector section 1 5 detects a face direction, from the differ- 
ence value obtained in the step S55. That is, for example, either one of the following two methods is utilized for process- 
ing of detecting a face direction from the difference value. Here, the difference value and the face direction angle are 
respectively expressed as X and Y. and the angle when the conference attendant 3A faces to a direction of the camera 

5 13 is defined as 0 degree. In an example of one of the methods for processing in the step S56. prior to detection 
processing of the face direction, statistics concerning the difference value X and the angle of the face direction Y are 
previously obtained, and the value of the face direction angle Y corresponding to the difference value X is obtained as 
an average value, for example. A graph of correspondence therebetween is prepared as shown in FIG. 18, and the face 
direction angle Y is obtained from the difference value obtained in the step $55. In an example of the other one of the 

io methods for processing in the step S56. the face direction angle Y is obtained by the following expression (13), using 
the difference value Y obtained in the step S55. 

Y=asin(X) (13) 

is [01 06 J By the flow as described above, the face direction of the conference attendant 3 A is detected in the direction 
detector section 1 5. 

[0107] As another specific method for detecting the direction in which the conference attendant 3A faces, it is pos- 
sible to carry out direction detection by using an image obtained in a manner in which infrared rays are irradiated onto 
to the face of the conference attendant 3 A and the infrared rays reflected on the face of the conference attendant 3 A 

20 may be received thereby to generate an image. 

[0108] Next, attention levels detected by the attention level detector section 131 . 132 and 133 of the remote confer- 
ence apparatus 1 A according to the present embodiment, and a specific example of adjustment processing performed 
by the adjusting sections 161, 162 and 163 on the basis of the detected attention level, wilt be explained below. 
[0109] A first example of the attention level detection and adjustment processing will be processing for amplifying 

2S sound data transmitted from the remote conference apparatus 1 B, 1 C and 1 D to the remote conference apparatus 1 A, 
in correspondence with a detection result of the direction detector section 15. FIG. 19 shows a schematic structure of 
a main part of the remote conference apparatus 1 A in case where sound data is amplified in correspondence with a 
detection result of the direction detector section 15, as the first specific example of the attention level detection and the 
adjustment processing. A specific structure and layout of structure components of the remote conference apparatus 1 A 

30 in FIG. 1 9 are arranged as shown in FIG. 20. In these FIGS. 19 and 20, those structural components that correspond 
to the components in FIGS. 3 and 4 will be designated with the same reference symbols as those of FIG. 3 and 4, and 
explanations thereof are omitted. 

[01 1 0] In these FIGS. 1 9 and 20, the direction detector section 1 5 of the remote conference apparatus 1 A detects 
a direction in which the conference attendant 3A faces, i.e.. the eye direction or face direction as described above, 
35 based on image data from the camera 13, and supplies the detection result to a sound volume operating section 221 
corresponding to the attention level detector section 1 31 , a sound volume operating section 222 corresponding to the 
attention level detector section 132. and a sound volume operating section 223 corresponding to the attention level 
detector section 133. 

[011 1] Based on a signal supplied from the direction detector section 15, the sound volume operating section 221 
40 operates and obtains an amplification rate G (t) used when a sound amplification or reduction is carried out by an ampli- 
fier section 231 in a rear stage, as a parameter P(t) in the attention level detector section 131 . That is, the sound volume 
operating section 221 obtains the amplification rate G(t) as a parameter P (t) of the expression (1). In this case, the min- 
imum parameter Pmin of the expression (1) is a minimum amplification rate Gmin. 

[01 1 2] Also, in the sound volume operating section 222. an amplification rate G (t) used when a sound amplification 
45 or reduction is carried out by an amplifier section in a rear stage is obtained as a parameter P (t) in the attention level 
detector section 1 31 , by operation based on a signal supplied from the direction detector section 131 . 
[01 1 3] Likewise, in the sound volume operating section 223, based on a signal supplied from the direction detector 
section 131 , an amplification rate G (t) used when sound amplification or reduction is carried out by an amplifier section 
in a rear stage is obtained as a parameter P (t) in the attention level detector section 131 , by operation. 
so [01 1 4] The amplification rate G (t) outputted from the sound volume operating section 221 is supplied to the ampli- 
fier section 231, the amplification rate G (t) outputted from the sound volume operating section 222 is outputted to the 
amplifier section 232, and the amplification rate G (t) outputted from the sound volume operating section 223 is supplied 
to the amplifier section 233. The amplifier section 231 is supplied with sound data from the remote conference appara- 
tus 1B through the data transmitter/receiver 16, the amplifier section 232 is supplied with sound data from the remote 
55 conference apparatus 1 C through the data transmitter/receiver 1 6, and the amplifier section 233 is supplied with sound 
data from the remote conference apparatus 1 D through the data transmitter/receiver 16. 

[01 1 5] When the amplifier section 231 receives the amplification rate G (t) supplied from the sound volume operat- 
ing section 221. the amplifier section 231 amplifies or reduces the sound of the conference attendant 38 supplied from 
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the remote conference apparatus 1 B, based on the amplification rate G (t). When the amplifier section 232 receives the 
amplification rate G (t) supplied from the sound volume operating section 222, the amplifier section 232 amplifies or 
reduces the sound of the conference attendant 3C supplied from the remote conference apparatus 1C, based on the 
amplification rate G (t). When the amplifier section 233 receives the amplification rate G (t) supplied from the sound vol- 
5 ume operating section 223. the amplifier section 233 amplifies or reduces the sound of the conference attendant 3D 
supplied from the remote conference apparatus 1D. based on the amplification rate G(t). 

[01 16] A sound signal outputted from the amplifier section 231 is supplied to the loudspeaker 121 and is outputted 
as sound. A sound signal outputted from the amplifier section 232 is supplied to the loudspeaker 122 and is outputted 
as sound. A sound signal outputted from the amplifier section 233 is transmitted to the loudspeakers 123 and is output- 
10 ted as sound. 

[0117] FIG. 21 shows a flow of processing in the remote conference apparatus 1A in case where sound data is 
amplified in correspondence with the detection result of the direction detector section 1 5, as a first example of a process 
of attention level detection and adjustment. 

[0118] In FIG. 21 , the direction detector section 15 of the remote conference apparatus 1 A analyzes image data 
i5 from the camera 1 3 and detects the direction in which the conference attendant 3 A faces, as processing in a step S1 . 
[0119] Next, as processing in a step S2, based on the detection result of the direction detector section 15, sound 
volume operating sections 221 , 222, and 223 respectively operate amplification rates Gain(t) with respect to sound data 
of the conference attendant 3B, 3C. and 3D transmitted from the corresponding remote conference apparatus 1B, 1C, 
and 1 D. using also the expression (1), and respectively supply the rates to the corresponding amplifier sections 231 to 
20 233. 

[0120] Next, as processing in a step S3, amplifier sections 221, 222 and 223 of the remote conference apparatus 
1A respectively amplify or reduce sound data of the conference attendants 3B, 3C, and 3D supplied from the corre- 
sponding remote conference apparatuses 1B, 1C. and 1D, based on the amplification rates Gain (t) supplied from the 
corresponding sound volume operating sections 221 , 222, and 223, and respectively output the data to the correspond- 
25 ing loudspeakers 121, 122, and 123. 

[0121 ] In this manner, as processing in a step S4, sounds based on the sound data inputted from the corresponding 
amplifier sections 231, 232, and 233 are respectively outputted from the corresponding loudspeakers 121, 122, and 
123 of the remote conference apparatus 1 A. 

[01 22] Next, a second specific example of detection of attention levels detected by the attention level detector sec- 

30 tions 131 , 132, and 133 of the remote conference apparatus 1 A according to the. present embodiment and adjustment 
processing carried out by the adjusting sections 161 , 162, and 163 on the basis of the detected attention levels will be 
sound quality processing that performs, for example, frequency characteristic control on sound data transmitted from 
the remote conference apparatuses 1B. 1C, and 1D to the remote conference apparatus 1A, in correspondence with 
the detection result of the direction detector section 15. 

35 [01 23] As a second specific example of attention level detection and adjustment processing, FIG. 22 shows a sche- 
matic structure of a main part of the remote conference apparatus 1 A in case where sound quality processing is per- 
formed in correspondence with the detection result of the direction detector section 15. A specific structure and layout 
of structural components of the remote conference apparatus 1A shown in the example of FIG. 23 are arranged as 
shown in FIG. 24. In these FIGS. 22 and 23, structural components corresponding to those in FIGS. 3 and 4 are des- 

40 ignated at the same reference symbols in FIGS. 3 and 4, and detailed explanation thereof will be omitted herefrom. 
[0124] In FIGS. 22 and 23. the direction detector section 15 of the remote conference apparatus 1A detects the 
direction in which the conference attendant faces, i.e., the eye direction or face direction as described above on the 
basis of the image data from the camera 13. and supplies the detection result to a sound quality operating section 281 
corresponding to the attention level detector section 131, a sound quality operating section 282 corresponding to the 

45 attention level detector section 132 and a sound quality operating section 283 corresponding to the attention level 
detector section 133. 

[0125] In the sound quality operating section 281 . based on a signal supplied from the direction detector section 1 5, 
a filter parameter K (t) used when carrying out frequency characteristic control in a sound processor 291 in a rear stage, 
i.e., filter processing (e.g„ low-pass filter processing) is obtained, as a fitter parameter P (t) in the attention level detector 

so section 131, by operation. That is, the sound quality operating section 281 obtains the fSter parameter K (t) as the 
parameter P (t). In this case, the minimum parameter Pmin is the minimum filter parameter Kmin. 
[0126] Also, in the sound quality operating section 262, based on the signal supplied from the direction detector 
section 15, a parameter P (t) when carrying out fitter processing in the sound processor in a rear stage thereof is 
obtained as a parameter P(t) of the attention level detector section 132, by operation. 

55 [01 27] Likewise, in the sound quality operating section 283, based on the signal supplied from the direction detector 
section 15, a parameter P (t) used when carrying out the filter processing in the sound processor 293 in a rear stage is 
obtained as a parameter P (t) in the attention level detector section 133. by operation. 

[01 28] The filter parameter K (t) outputted from the sound quality operating section 281 is transmitted to the sound 
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processor 292, the filter parameter K (t) outputted from the sound quality operating section 282 is transmitted to the 
sound processor 292, and the filter parameter K (t) outputted from the sound quality operating section 283 is transmit- 
ted to the sound processor 293. The sound processor 291 is supplied with sound data from the remote conference 
apparatus 1B through the data transmitter/receiver 16, the sound processor 292 is supplied with sound data from the 

5 remote conference apparatus 1C through the data transmitter/receiver 16. and the sound processor 293 is supplied 
with sound data from the remote conference apparatus 1 D through the data transmitter/receiver 1 6. 
[01 29] Upon receipt of the filter parameter K (t) supplied from the sound quality operating section 281 . the sound 
processor 291 performs filter processing such as low-pass filter processing (LPF processing) on sound data of the con- 
ference attendant 3B supplied from the remote conference apparatus 1 B. based on the parameter K (t). Upon receipt 

to of the filter parameter K (t) supplied from the sound quality operating section 282, the sound processor 292 performs 
filter processing such as low-pass filter processing (LPF processing) on sound data of the conference attendant 3C 
supplied from the remote conference apparatus 1C, based on the parameter K (t). Upon receipt of the filter parameter 
K (t) supplied from the sound quality operating section 283, the sound processor 293 performs filter processing such as 
low-pass filter processing (LPF processing) on sound data of the conference attendant 3D supplied from the remote 

is conference apparatus 1 D, based on the parameter K (t). 

[01 30] A sound signal outputted from the sound processor 291 is transmitted to the loudspeaker 121 and is output- 
ted as sound. A sound signal outputted from the sound processor 292 is transmitted to the loudspeaker 122 and is out- 
putted as sound. A sound signal outputted from the sound processor 293 is transmitted to the loudspeaker 123 and is 
outputted as sound. 

20 [01 31 1 FIG. 24 shows a specific structural example of the sound processors 291 , 292 and 293. The sound proces- 
sors 291 . 292, and 293 have one same structure, and therefore, only the structure of the sound processor 291 is shown 
in FIG. 24. for example. 

[0132] In FIG. 24, sound data having a frequency characteristic as shown in FIG. 25. which is supplied from the 
remote conference apparatus 1 B through the data transmitter/receiver, is inputted to a terminal 302, and a filter param- 

25 eter K(t) having a frequency control characteristic as shown in FIG. 26, which is supplied from the sound quality oper- 
ating section 281 , is inputted to a terminal 301 . Fmax shown in FIG. 26 is a maximum frequency (fixed value) of input 
sound. The sound data supplied through the terminal 302 and the filter parameter K (t) supplied through the terminal 
301 are inputted to a LPF (low-pass filter) 300 which is a main structural component of the sound processor 291. 
[0133] The LPF 300 performs low-pass filer processing having a cutoff frequency of K (t) Fmax, as shown in FIG. 

30 26. on the sound data inputted from the terminal 302 and having a characteristic as shown in FIG. 25. By this process- 
ing, output sound data having a characteristic shown in FIG. 27 is obtained from the LPF 300. The output sound data 
is transmitted from the terminal 303 to the loudspeaker 121 structured in a rear stage. Sound outputted from the loud- 
speaker 121 becomes sound subjected to frequency characteristic control which enables easy listening when attention 
is paid. 

35 [01 34] F IG. 28 shows, as a second specific example of the attention level detection and the adjustment processing, 
a flow of processing in the remote conference apparatus 1 A in case where filter processing is performed in correspond- 
ence with the detection result of the direction detector section 15. 

[0135] In FIG. 28. the direction detector section 15 of the remote conference apparatus 1A analyzes image data 
from the camera 13 and detects the direction in which the conference attendant 3 A faces, as processing in a step.S61 . 
40 [01 36] Next, as processing in a step S62, the sound quality operating sections 281 . 282, and 283 respectively oper- 
ate filter parameters K (t) with respect to sound data of the conference attendants 3B, 3C, and 3D transmitted from the 
remote conference apparatuses 1B, 1C, and 1D, based on the detection result of the direction detector section 15, by 
using the expression (1) described previously, and respectively supply the data to corresponding sound processors 291 
to 293. 

45 [01 37] Next, as processing in a step S63. sound processors 291 , 292, and 293 of the remote conference apparatus 
1 A respectively perform filter processing on sound data of the conference attendants 3B, 3C, and 3D supplied from the 
corresponding remote conference apparatuses 1 B, 1C, and 1 D. based on the parameters P (t) supplied from the corre- 
sponding sound quality operating sections 281 . 282, and 283. and respectively output sound data to the corresponding 
loudspeakers 1 21 , 1 22, and 1 23. 

so [01 38] In this manner, as processing of a step S64, sounds based on the sound data inputted from the correspond- 
ing sound processors 291, 292 and 293 respectively are outputted from the loudspeakers 121, 122, and 123 of the 
remote conference apparatus 1A. 

[0139] As described above, according to the remote conference apparatus 1 A as a second specific example of the 
attention level detection and the adjustment process in case where sound data is subjected to filter processing in cor- 
55 respondence with the detection result of the direction detector section 15. when a time equal to or longer than a con- 
stant time Tcon passes in a state in which the conference attendant 3A keeps facing toward any of the monitor sections 
1 1 1 , 1 12, and 1 13, the conference attendant 3A is determined as paying attention to another conference attendant dis- 
played on the monitor section provided in the direction, and the sound quality of the conference attendant to whom 
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attention is paid is raised white the sound quality of the other conference attendants who are displayed on the other 
monitor sections to which attention is not paid is lowered. As a result, it is possible to listen easily the speech of the con- 
ference attendant who is displayed on the monitor section in the direction in which the conference attendant 3A pays 
attention. 

5 [0140] Also, according to the remote conference apparatus 1 A in the case of the second specific example, even 
when the conference attendant 3 A stops paying attention to the conference attendant displayed on a monitor section in 
a certain direction, the sound quality is kept high until the time Tcont passes, and the sound quality is decreased grad- 
ually thereafter. In this manner, for example, even if the conference attendant 3 A turns gradually to another conference 
attendant than the conference attendant to whom the conference attendant 3 A has been paying attention, it is not nec- 

10 essary to lower the sound quality of the conference attendant to whom the conference attendant 3 A has originally been 
paying attention. 

[0141 ] Further, according to the remote conference apparatus 1 A in the case of the second specific example, when 
a constant time Tcont or a longer time passes in a state where the conference attendant 3 A keeps facing to any monitor 
section, the conference attendant 3 A is determined as paying attention to the monitor section in this direction. There- 
15 fore, for example, the sound quality control is prevented from responding too sensitively, for example, when the direction 
of the conference attendant 3 A temporarily shifts or when the conference attendant 3A temporarily faces to each of 
monitor sections. 

[0142] Next, as a third specific example of the processing of detection of attention levels in the attention level 
detecting sections 131, 132, and 133 and adjustment processing carried out by the adjusting sections 161, 162, and 
20 163 based on the detected attention levels, it is possible to cite processing in which image data supplied to the remote 
conference apparatus 1 A from the other remote conference apparatuses 1 B, 1 C, and 1 D is subjected to image quality 
processing in accordance with the detection result of the direction detector section 15. 

[0143] FIG. 29 shows, as the third specific example of the attention level detection and the adjustment processing, 
a schematic structure of a main part of the remote conference apparatus 1 A in case where image quality processing is 
25 performed in accordance with the detection result of the direction detector section 1 5. A specific structure and layout of 
the structural components of the remote conference apparatus 1 A in the example of FIG. 29 are arranged as shown in 
FIG. 30. In FIGS. 29 and 30, structural components corresponding to FIGS. 3 and 4 are denoted at the same reference 
symbols, and detailed explanation thereof will be omitted herefrom. 

[0144] In FIGS. 29 and 30. the direction detector section 15 of the remote conference apparatus 1 A detects the 
30 direction in which the conference attendant 3A faces based on image data from the camera 13, i.e., detects the eye 
direction or face direction as described above, and supplies a detection result to an image quality operating section 31 1 
corresponding to the attention level detector section 131 , an image quality operating section 312 corresponding to the 
attention level detector section 132. and an image quality operating section 313 corresponding to the attention level 
detector section 133. 

35 [0145] In the image quality operating section 311. based on the signal supplied from the direction detector section 
15, an image quality adjustment value V (t) used when image processing is performed in the image processor 321 in a 
rear stage is obtained as a parameter P (t) in the attention level detector section 131 by operation. That is, the image 
quality operating section 31 1 obtains the image quality adjustment value V (t) as the parameter P(t) in the expression 
(1). In this case, the minimum parameter Pmin in the expression (1) is the minimum control value Vmin. The image 

40 processing will be color processing achieved by adjusting gains of primary color data of R (red), G (green), and B (blue), 
brightness adjustment processing, processing for adjusting the resolution and sharpness of an image, and the like. 
[0146] In the image quality operating section 312, based on the signal supplied from the direction detector section 
15,.an image quality adjustment value V (t) used when image processing is performed in the image processor 322 in a 
rear stage is obtained as a parameter P (t) in the attention level detector section 132, by operation. 

45 [0147] In the image quality operating section 313, based on the signal supplied from the direction detector section 
15. an image quality adjustment value V (t) used when image processing is performed in the image processor 323 in a 
rear stage is obtained as a parameter P (t) at the attention level detector section 133, by operation. 
[0148] The image quality adjustment value V (t) outputted from the image quality operating section 31 1 is transmit- 
ted to the image processor 321, the image quality adjustment value V (t) outputted from the image quality operating 

so section 31 2 is transmitted to the image processor 322, and the image quality adjustment value V (t) outputted from the 
image quality operating section 313 is transmitted to the image processor 323. Image data from the remote conference 
apparatus 1B is supplied to the image processor 321 through the data transmitter/receiver 16, image data from the 
remote conference apparatus 1C is supplied to the image processor 322 through the data transmitter/receiver 16, and 
image data from the remote conference apparatus 1 D is supplied to the image processor 323 though the data transmit- 

55 ter/receiver 16. 

[0149] Upon receipt of the image quality adjustment value V (t) supplied from the image quality operating section 
31 1 , the image processor 321 performs image processing on image data of the conference attendant 3B supplied from 
the remote conference apparatus 1 B, based on the image value V (t). Also, upon receipt of the image quality adjustment 
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value V (t) supplied from the image quality operating section 312, the image processor 322 performs image processing 
on image data of the conference attendant 3C supplied from the remote conference apparatus 1C. based on the image 
quality adjustment value V (t). Likewise, upon receipt of the image quality adjustment value V (t) supplied from the 
image quality operating section 313, the image processor 323 performs image processing on image data of the confer- 
5 ence attendant 3D supplied from the remote conference apparatus 1 0, based on the image quality adjustment value V 
(t). 

[01 50} An image signal outputted from the image processor 321 is transmitted to the monitor section 1 13 and is dis- 
played as an image. 

[01 51 ] FIG. 31 shows a specific example of structures of the image processors 321 . 322, and 323. The image proc- 
io essors 321, 322, and 323 have one same structure, and therefore, only the structure of the image processor 321 is 
shown in FIG. 31, for example. In FIG. 31, processing for adjusting gains of primary colors R, G, and B is cited as an 
example of the image processing. 

[0152] In FIG. 31. terminals 332, 333, and 334 are inputted wit primary color data R, G, and B supplied from the 
remote conference apparatus 1 B though the data transmitter/receiver 16, and a terminal 331 is inputted with the image 
is quality adjustment value V (t) supplied from the image quality operating section 321 . The primary color data R. G, and 
B though the terminals 332, 333, and 334, and the image quality adjustment value V (t) through the terminal 331 are 
inputted to the image processor 321. 

[01 53J Tne image processor 321 performs image processing using the image quality adjustment value V (t) input- 
ted from the terminal 331, on the primary color data of R, G, and B inputted from the terminals 332, 333, and 334. By 
so this processing, signals obtained by adjusting primary color signals of R, G, and B respectively by the image quality 
adjustment values V (t) are outputted from the image processor 321 . The data of R, G, and B after the image processing 
are respectively outputted from terminals 335, 336, and 337 and transmitted to the monitor section 1 1 1 having the fol- 
lowing structure. 

[01 54] FIG. 32 shows, as a third specific example of the attention level detection and the adjustment processing, a 
25 flow of processing in the remote conference apparatus 1 A in case where image processing is performed on the image 
data in correspondence with the detection result of the direction detector section 1 5. 

[0155] In FIG. 32, the direction detector section 15 of the remote conference apparatus 1A analyzes image data 
from the camera 1 3 and detects the direction in which the conference attendant 3 A, as processing in a step S71 . 
[0156] Next, as processing in the step S72, the image quality operating sections 311, 312. and 313 respectively 
30 operate the image quality adjustment values V (t) corresponding to image data of the conference attendants 3B, 3C, 
and 3D transmitted from the remote conference apparatuses 1 B, 1 C, and 1 D, based on the detection result of the direc- 
tion detector section 1 5 by using the expression (1 ), and respectively supply the data to the image quality operating sec- 
tions 321 to 323. 

[0157] Next, as processing in a step S73, the image quality operating sections 321 , 322, and 323 of the remote con- 
as ference apparatus 1A respectively perform image quality adjustment processing on image data of the conference 
attendants 3B, 3C. and 3D supplied from the remote conference apparatuses 1 B, 1 C, and 1 D, based on the image qual- 
ity adjustment values V (t) supplied from the picture quality operating sections'311, 312, and 313, and respectively out- 
put the data to the monitor sections 1 1 1 , 1 12, and 1 13. 

[01 58] In this manner, images based on the image data inputted from the image processors 321 , 322, and 323 are 
40 respectively displayed on the monitor sections 111,112, and 1 1 3 of the remote conference apparatus 1 A, as process- . 
ing in a step S74. 

[0159] As described above, as the third specific example of the attention level detection and the adjustment 
processing, according to the remote conference apparatus 1 A in case where image processing is performed on image 
data in correspondence with the detection result of the direction detector section 1 5, when a time equal to or longer than 

45 a constant time Tcont passes in a situation in which the conference attendant 3A keeps facing in a direction to any of 
the monitor section 111, 112, and 1 13, the remote conference apparatus 1 A determines the attendant 3A as paying 
attention to the monitor in the direction, and raises image quality (color, brightness, resolution, sharpness, and the like 
of an image) of the conference attendant to whom the conference attendant 3 A faces, while image quality of the con- 
ference attendant who is displayed on the monitor section to which attention is not paid is lowered. As a result, the 

so image of the conference attendant displayed on the monitor section to which the conference attendant 3A faces can be 
watched easily. 

[01 60] Also, according to the remote conference apparatus 1 A in the third specific example, even when the confer- 
ence attendant 3A stops facing to the conference attendant displayed on the monitor section in a certain direction, 
image quality of the conference attendant is kept high until the time Tcont passes, and the image quality is thereafter 
ss lowered gradually. Therefore, for example, in case where the conference attendant 3A turns gradually to another con- 
ference attendant than the conference attendant to whom the conference attendant 3 A has been paying attention, it is 
unnecessary to lower the image quality of the conference attendant to whom the conference attendant 3A has originally 
been paying attention. 
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[01 61 ] Further, according to the remote conference apparatus 1 A in the third specific example, when a time equal 
to or longer than the constant time Tcont passes in a situation the conference attendant 3 A keeps facing in a direction 
to any monitor section, the conference attendant 3 A is determined as paying attention to the monitor section in the 
direction. Therefore, for example, when the facing direction of the attendant 3A shifts temporarily or when the attendant 

5 3A faces temporarily to each monitor section, the image quality control is prevented from responding too sensitively. 
[01 62] Next, another example of the structure of the remote conference apparatus 1 A is shown in FIG. 33. 
[0163] In the example of the structure shown in FIG. 33. as a display device for displaying images of conference 
attendants 3B, 3C, and 3D of the other remote conference apparatuses 1 B, 1C. and 1 D, one curved screen 31 is pro- 
vided in place of the monitor sections 111,112, and 1 13 corresponding to the remote conference apparatuses 1 B, 1 C, 

10 and 1 0 shown in FIG. 2. 

[01 64] That is, in this structural example, images of the other conference attendants 3B, 3C, and 3D are displayed 
as if the other conference attendants 3B, 3C, and 3D together with the conference attendant 3A sat around one table 
and had a conference. 

[0165] A camera 34 and a microphone 35 are provided, for example, in front of the conference attendant 3A and 
is image data of the conference attendant 3A picked up by the camera 34 and sound data of the conference attendant 3A 
collected by the microphone 35 are transmitted to the remote conference apparatuses 1B to 1D through ISDN 2. 
[0166] Meanwhile, sound data of the conference attendant 3B transmitted from the remote conference apparatus 
1 B is controlled such that the sound image thereof is centered near the image of the conference attendant 3B which is 
displayed on the screen 31 . This sound data is supplied to the loudspeakers 32 and 33 arranged in both the right and 
20 left sides of the screen 31 , and sound is outputted. Also, sound data of the conference attendant 3C transmitted from 
the remote conference apparatus 1 C is controlled such that the sound image thereof is centered near the image of the 
conference attendant 3C which is displayed on the screen 31. This sound data is supplied to the loudspeakers 32 and 
33 arranged in both the right and left sides of the screen 31 , and sound is outputted. Likewise, sound data of the con- 
ference attendant 3D transmitted from the remote conference apparatus 1D is controlled such that the sound image 
25 thereof is centered near the image of the conference attendant 3D which is displayed on the screen 31 . This sound data 
is supplied to the loudspeakers 32 and 33 arranged in both the right and left sides of the screen 31 , and sound is out- 
putted. 

[0167] Also, in this structure shown in FIG. 33, sound data and image data of the conference attendants 3B to 3D 
are adjusted individually in correspondence with an attention level (parameter P(t)) obtained on the basis of the direc- 
30 tion in which the conference attendant 3 A faces, detected with use of the image data of the conference attendant 3 A 
picked up by the camera 34, as described above. 

[0168] Next, FIG. 34 shows an example of the other structure of the remote conference apparatus 1 A. 
[0169] That is, FIG. 34 shows an example of a structure of the remote conference apparatus 1A in which a curved 
screen 41 is provided like the example of the structure shown in FIG. 33 and further two conference attendants 3A and 
35 3E can sit together. 

[0170] In this structural example shown in FIG. 34, images of the other conference attendants 3B, 3C, and 3D are 
displayed on the screen 41 as if the other conference attendants 3B, 3C and 3D together with the conference attendants 
3 A and 3E had a conference around one table. 

[0171] A camera 44 and a microphone 46 are provided, for example, in front of the conference attendant 3A, and 

40 an image of the conference attendant 3A picked up by the camera 44 and sound data of the conference attendant 3A 
collected by the microphone 44 are transmitted to the remote conference apparatuses 1B to 1 D through ISDN 2. 
[01 72] Also, a camera 45 and a microphone 47 are provided, for example, in front of the conference attendant 3E. 
and an image of the conference attendant 3E picked up by the camera 45 and sound data of the conference attendant 
3E collected by the microphone 45 are transmitted to the remote conference apparatuses 1 B to 1 D through the ISDN 2. 

45 [01 73] Sound data of the conference attendant 3B transmitted from the remote conference apparatus 1 B is control- 
led such that the sound image is centered near the image of the conference attendant 3B which is displayed on the 
screen 41 . This sound data is supplied to the loudspeakers 42 and 43 arranged in both the right and left sides of the 
screen 41 , and sound is outputted. Also, sound data of the conference attendant 3C transmitted from the remote con- 
ference apparatus 1 C is controlled such that the sound image is centered near the image of the conference attendant 

so 3C which is displayed on the screen 41. This sound data is supplied to the loudspeakers 42 and 43 arranged in both 
the right and left sides of the screen 41 , and sound is outputted. Likewise, sound data of the conference attendant 3D 
transmitted from the remote conference apparatus 1 D is controlled such that the sound image is centered near the 
image of the conference attendant 3D which is displayed on the screen 41. This sound data is supplied to the loud- 
speakers 42 and 43 arranged in both the right and left side of the screen 31. and sound is outputted. 

55 [01 74] In this structural example shown in FIG. 34, sound data and image data of the conference attendants 3B to 
3D are adjusted individually as described above in correspondence with an average value between an attention level 
(parameter P (t)) obtained on the basis of the direction in which the conference attendant 3A faces, detected with use 
of the image data of the conference attendant 3A picked up by the camera 44, and an attention level (parameter P (t)) 
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obtained on the basis of the direction in which the conference attendant 3E faces, detected with use of the image data 
of the conference attendant 3E picked up by the camera 45. With respect to the image data, however, it is also possible 
to adjust the image data individually as described above in correspondence with the parameters P (t), without obtaining 
an average value between the parameter P (t) based on the direction of the conference attendant 3A and the parameter 

5 P(t) based on the direction of the conference attendant 3E. 

[01 75] Next, FIG. 35 shows another example of the structure of the remote conference apparatus 1 A. 
[0176) That is, the structural example in FIG. 35 shows a case where one screen 51 curved like in the example of 
the structure in FIG. 34 so that further two conference attendants 3A and 3E can sit together but headphones 52 and 
53 are provided for the conference attendants 3A and 3E in place of the loudspeakers 42 and 43 of the structural exam- 

io pie in FIG. 34. 

[0177] In this structural example shown in FIG. 35, images of the other conference attendants 38, 3C and 3D are 
displayed on the screen 51 as if the other conference attendants 3B, 3C and 30 together with the conference attendant 
3A and 3E sat around one table and had a conference together. 

[0178] A camera 54 and a microphone 56 are provided, for example, in front of the conference attendant 3A, and 

is image data of the conference attendant 3A picked up by the camera 54 and sound data of the conference attendant 3 A 
collected by the microphone 56 are transmitted to the remote conference apparatuses 1 B to 1D through ISDN 2. 
[0179] Also, a camera 55 and a microphone 57 are provided, for example, in front of the conference attendant 3E, 
and image data of the conference attendant 3E picked up by the camera 55 and sound data of the conference attendant 
3E collected by the microphone 55 are transmitted to the remote conference apparatuses 1 B to 1 D through ISDN 2. 

20 [0180] Meanwhile, sound data of the conference attendant 3B transmitted from the remote conference apparatus 
1 B is controlled such that the sound image is centered near the image of the conference attendant 3B which is dis- 
played on the screen 51 . This sound data is supplied to the headphones 52 and 53 which the conference attendants 
3A and 3E put on, and sound is outputted. Also, sound data of the conference attendant 3C transmitted from the remote 
conference apparatus 1C is controlled such that the sound image is centered near the image of the conference attend- 

25 ant 3C which is displayed on the screen 51 . This sound data is supplied to the headphones 52 and 53 which the con- 
ference attendants 3 A and 3E put on, and sound is outputted. Likewise, sound data of the conference attendant 3D 
transmitted from the remote conference apparatus 1 D is controlled such that the sound image is centered near the 
image of the conference attendant 3D which is displayed on the screen 51 . This sound data is supplied to the head- 
phones 52 and 53 which the conference attendants 3 A and 3 E put on, and sound is outputted. 

30 [0181] In this structural example shown in FIG. 35. sound data and image data of the conference attendants 3B to 
3D are adjusted individually as described above in correspondence with an attention level (parameter P (t)) obtained on 
the basis of the direction in which the conference attendant 3 A faces, detected with use of the image data of the con- 
ference attendant 3 A picked up by the camera 54. and an attention level (parameter P (t)) obtained on the basis of the 
direction in which the conference attendant 3E faces, detected with use of the image data of the conference attendant 

35 3E picked up by the camera 55. With respect to the image data, it is also possible to adjust the image data individually 
as described above in correspondence with an average value between the parameter P(t) based on the direction of the 
conference attendant 3A and the parameter P(t) based on the direction of the conference attendant 3E. 
[0182] Next, FIG. 36 shows another example of the structure of the remote conference apparatus 1 A. 
[0183] In this structural example shown in FIG. 36, image data of the other conference attendants 3B, 3C, and 3D 

40 are not communicated but only the sound data are communicated. Therefore, in the structural example in FIG. 36. loud- . 
speakers 61 . 62, and 63 for outputting sounds of the other conference attendants 3B, 3C, and 3D are provided as if the 
other conference attendants 3B, 3C, and 3D together with the conference attendant 3 A sat around one table and had 
a conference together. Note that objects symbolizing the conference attendants 3B, 3C, and 3D, such as photos 65B, 
65C, and 65D, are provided near the loudspeakers 61 . 62, and 63 which output sound data of the conference attend- 

45 ants 3B, 3C, and 3D. 

[0184] A camera 64 and a microphone 66 are provided, for example, in front of the conference attendant 3 A, and 
image data of the conference attendant 3 A picked up by the camera 64 and sound data of the conference attendant 3 A 
collected by the microphone 66 are transmitted to the remote conference apparatuses 1 B to 1D through the ISDN 2. 
[01 85] Sound data of the conference attendant 3B transmitted from the remote conference apparatus 1 B is output- 

50 ted as sound from the loudspeaker 61 , sound data of the conference attendant 3C transmitted from the remote confer- 
ence apparatus 1C is outputted as sound from the loudspeaker 62, and sound data of the conference attendant 3D 
transmitted from the remote conference apparatus 1D is outputted as sound from the loudspeaker 63. 
[0186] Also, in this structural example shown in FIG. 36, sound data of the conference attendants 3B to 3D are 
adjusted individually as described above in correspondence with an attention level (parameter P(t)) on the basis of the 

55 direction in which the conference attendant 3 A faces, detected with use of the image data of the conference attendant 
3A picked up by the camera 64. 

[0187] Though the present embodiment cites an example in which the direction detector section 15 is provided in 
the remote conference apparatus, it is possible to provide independently the direction detector section 15 in a network. 
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[0188] Also, the present embodiment cites specific examples in which the eye direction and the face direction are 
detected individually, it is possible to carry out detection of both directions simultaneously. In addition, though the 
present embodiment describes that adjustments of the sound volume, sound quality, and image quality are performed 
individually in the specific examples of adjustment corresponding to an attention level detection result, it is possible to 
carry out two or three of those adjustments in combination with each other. 

[0189] Further, each processing described above can be is carried out by a computer program, for example. In this 
case, the computer program for carrying out each processing may be provided for users by network providing mecSa, 
such as the internet, digital satellite commutations, and the like, in addition to providing media in form of information 
recording media, such as magnetic disks, CD-ROMs. DVDs, and the like. 

Industrial Applicability 

[0190] As described above, according to the communication apparatus and the communication method of the 
present invention, the eye direction or face direction of a user is detected with use of image data picked up, and the level 
of attention paid by the user is obtained from the detected eye direction or face direction of the user. Based on the atten- 
tion level; voices and images of other users inputted from other communication apparatuses are adjusted individually, 
so a desired speech can be heard easily and a desired image can be watched also easily. 

Claims 

1 . A communication apparatus used in a communication system in which communication is made between three or 
more communication apparatuses, characterized by comprising: 

a direction detector section for detecting a direction in which a user faces among a plurality of directions, where 
the directions respectively correspond to other ones of the communication apparatuses; 

an attention level detector section for detecting attention levels at which the user faces in the plurality of direc- 
tions, respectively, based on a detection result from the direction detector section; 

a receiver section for receiving information from the other ones of the communication apparatuses; and 

an adjusting section for adjusting information from the other ones of the communication apparatuses in corre- 
spondence with the attention levels. 

2. An apparatus according to claim 1 characterized in that when the direction detector section keeps detecting one 
same direction for a first time period or longer, the attention level detector section detects the attention level from 
the user as being high, with respect to the one same direction detected by the direction detector section. 

3. An apparatus according to claim 2, characterized in that based on detection of another one of the directions after 
the direction detector section keeps detecting the one same direction for the first time period or longer, the attention 
level detector section lowers the attention level. 

4. An apparatus according to claim 3. characterized in that if a second time period passes from a timing at which the 
direction detector section detects the another direction, the attention level detector section lowers the attention 
level. 

5. An apparatus according to claim 3, characterized in that the attention level detector section gradually lowers the 
attention level in response to a timing at which the direction detector section detects the another direction. 

6. An apparatus according to claim 5, characterized in that the attention level detector section lowers the attention 
level gradually when a second time period passes from the timing when the direction detector section detects the 
another direction. 

7. An apparatus according to claim 1 , characterized in that the attention level detector section detects the attention 
level for each of the directions. 

8. An apparatus according to claim 7, characterized in that the adjusting section adjusts the information, based on the 
attention levels for the directions, respectively. 
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1 1 . An apparatus according to claim 1 . characterized in that the arfmctin« e^r r *. ■ 

10 

19. An apparatus according to claim 1, characterized by further comprising 
an obtaining section for obtain information of the user, and 

an adjusting step of adjusting information received from the other one* nt th* r«™«. 

correspondence with the attention levels communication apparatuses in 
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23 . A method acting to d*. 22. diaracterized in M h ~ Si' ^ ^ 
passes from a timing at which the another director, b detected, the attention level « lowered. 

24 A method according to daim 22. characterized in that in the directiondeteoting step, the attention level is gradually 
lowered in response to a timing at which the another direction s detected. 

detecting step. 

" 26. A method according to claim 20. characterized in that in the attention level detecting step, the attention level is 
detected for each of the directions. 
27. A method according to daim 26. characterized in that in the adjusting step, the information is adjusted, based on 
rs the attention levels for the directions, respectively. 

JB-Ametrrrfaccordir^tocla^^ 

detected. 

20 29 . Ame modaccor tf ,ng«odaim^^ 

detected: 

25 31. Amethcdac^rdlngtocteumZO.^ 

tion adjusted in the adjusting step to a user. 

32. A memod according to claim 31. characterized in that in the adjusting step, sound information presented in the 
30 presentation step is adjusted. 

33. Amethod adding toclaim32.cha^^^^ 
sented in the presentation step is adjusted. 

3S 34. Ameti^accordingtocla^ 

sented in the presentation step is adjusted. 

35. A method according to claim 31 , characterized in that 
40 the information is image information, and 

in the adjusting step, image information presented in the presentation step is adjusted. 

36. Amethod according to daim 35. characterized in *at in *e adjusting step. 
45 presented in the presentation step is adjusted. 

37 An-ihodaccoK^ 

* of presentations respectively corresponding to the plurality of d.rect.ons. 

so 38. A method according to claim 20. characterized by further comprising 

. an obtaining step of obtaining information of the user, and 

atransrrtttingstepo^^ 
55 munication apparatuses. 
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